A NEW DAMPING STRATEGY OF LEVENBERG-MARQUARDT ALGORITHM FOR MULTILAYER PERCEPTRONS
نویسندگان
چکیده
منابع مشابه
A New Damping Strategy of Levenberg-marquardt Algorithm for Multilayer Perceptrons
In this paper, a new adjustment to the damping parameter of the Levenberg-Marquardt algorithm is proposed to save training time and to reduce error oscillations. The damping parameter of the Levenberg-Marquardt algorithm switches between a gradient descent method and the Gauss-Newton method. It also affects training speed and induces error oscillations when a decay rate is fixed. Therefore, our...
متن کاملA New Cuckoo Search Based Levenberg-Marquardt (CSLM) Algorithm
Back propagation neural network (BPNN) algorithm is a widely used technique in training artificial neural networks. It is also a very popular optimization procedure applied to find optimal weights in a training process. However, traditional back propagation optimized with Levenberg marquardt training algorithm has some drawbacks such as getting stuck in local minima, and network stagnancy. This...
متن کاملLevenberg Marquardt ( LM ) Algorithm 1 –
1 – Introduction Parameter estimation for function optimization is a well established problem in computing, as there are countless applications in practice. For this work, we will focus specifically in implementing a distributed and parallel implementation of the Levenberg Marquardt algorithm, which is a well established numerical solver for function approximation given a limited data set. Para...
متن کاملMulti-layer perceptrons with Levenberg- Marquardt training algorithm for suspended sediment concentration prediction and estimation
The prediction and estimation of suspended sediment concentration are investigated by using multi-layer perceptrons (MLP). The fastest MLP training algorithm, that is the Levenberg-Marquardt algorithm, is used for optimization of the network weights for data from two stations on the Tongue River in Montana, USA. The first part of the study deals with prediction and estimation of upstream and do...
متن کاملA Layer-by-Layer Levenberg-Marquardt algorithm for Feedforward Multilayer Perceptron
The error backpropagation (EBP) algorithm for training feedforward multilayer perceptron (FMLP) has been used in many applications because it is simple and easy to implement. However, its gradient descent method prevents EBP algorithm from converging fast. To overcome the slow convergence of EBP algorithm, the second order methods have adapted. Levenberg-Marquardt (LM) algorithm is estimated to...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Network World
سال: 2011
ISSN: 1210-0552,2336-4335
DOI: 10.14311/nnw.2011.21.020